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Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

• Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 

after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 Responsive to communication(s) filed on 27 September 2007 . 
2a)^ This action is FINAL. 2b)n This action is non-final. 

3) 0 Since this application is in concJition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213, 

Disposition of Claims 

4) S Claim(s) 1,3A,11 and 12 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) 0 Claim(s) is/are allowed. 

6) ^ Claim{s) t3A.11 and 12 is/are rejected. 
?)□ Claim{s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) 0 The specification is objected to by the Examiner. 

10)D The drawing(s) filed on is/are: a)n accepted or b)^ objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 

Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 
1 1 )n The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-1 52. 

Priority under 35 U.S.C. § 119 

12)D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
a)n All b)n Some * c)^ None of: 

1 .□ Certified copies of the priority documents have been received. 

2.n Certified copies of the priority documents have been received in Application No. . 

3.0 Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 
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DETAILED ACTION 
Applicant(s) Response to Official Action 

[1] The response filed on September 27, 2007 has been entered and made of record. 



Response to Arguments/Amendments 

[2] Presented arguments have been fuUy considered, but are rendered moot in view of the new 
ground(s) of rejection necessitated by amendment(s) initiated by the applicant(s). 



Claim Rejections - 35 USC §101 

35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of matter, or any 
new and useful improvement thereof, may obtain a patent therefor, subject to the conditions and requirements of 
this tide. 

[3] Regarding claim 11, the disclosed invention lacks utility. Claimed invention does not produce 
a useful, concrete and tangible result. 



Claim Rejections - 35 USC § 112 

The following is a quotation of the first paragraph of 35 U.S.C. 1 12: 

The specificadon shall contain a written description of the invention, and of the manner and process of making and 
using it, in such full, clear, concise, and exact terms as to enable any person skilled in the art to which it pertains, or 
with which it is most nearly connected, to make and use the same and shall set forth the best mode contemplated by 
the inventor of carrying out his invention. 

[4] Claim 11 is rejected under 35 U.S.C. 112, first paragraph, as failing to comply with the 
enablement requirement. The claim(s) contains subject matter which was not described in the 
specification in such a way as to enable one skilled in the art to which it pertains, or with which it is 
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most nearly connected, to make and/or use the invention. The limitation of, "the indices including 
ordinate level within schema structure, perceptual schema, and human categorization", is not 
disclosed. 

Claim Rejections - 35 USC §103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness 
rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in section 
102 of this tide, if the differences between the subject matter sought to be patented and the prior art are such that the 
subject matter as a whole would have been obvious at the time the invention was made to a person having ordinary 
skill in the art to which said subject matter pertains. Patentability shall not be negatived by the manner in which the 
invention was made. 

[5] Claims 1, 3, 4, 11 and 12 are rejected under 35 U.S.C. 103(a) as being unpatentable over Chu' 
et al. ("Chu*') in view of Gon2ale2" et al. ("Gonzalez"). 

Regarding claim 1, Chu meets the claim limitations, as follows: 

An electronic digital image processing system [ftgs, 6-1, 6-1 5] ^ comprising: one or 
more pre-processors [fig, 6-15: inherently present]^ a processing engine (i.e, program or 
software inherently present) with multiple processing units (Le. each layer) each re- 
parameterizing input variables (i,e, raw images in RL layer) to graded category variables 
(i.e. TAH) to accomplish processing functions, the processing functions including 
segmentation (i,e. section 6.3.1) and grouping by similarities (i.e. clustering image objects) 
[fig. 6-1; page 151, para. 2/, a perceptual schema (i.e. metadata) database [page 149, para. 
4], and an output generator that produces structured image data [abstract: image and 
metadata is a structured image data]. 
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Chu does not explicitly disclose the following claim limitations (emphasis added): 

The processing functions including color segmentation. 
However, in the same field of endeavor Gonzalez discloses the deficient claim limitations, as 
follows: 

The processing functions including color segmentation /page 331, para. 2j. 
It would have been obvious to one with ordinary skill in the art at the time of invention to 
modify the teachings of Chu with Gonzalez to implement color segmentation, the reasoning 
being to apply Chu's invention to color images. 

Regarding claim 3, Chu meets the claim limitations, as follows: 

The system of claim 1, wherein the system processes digital images (i.e, raw images) in 
an adaptive fashion, with each processing unit (Le. layer) making adjustments to the 
data in the schema (i,e. metadata) and adapting the data adjustments (Le, processed data is 
serves as input to the next layer) made by other processing units in processing the digital 
image [fig, 6-1 ; page 149, para, 4], 

Regarding claim 4, Chu meets the claim limitations, as follows: 

The system of claim 1, wherein the processing units (i,e, layers) are inter-dependent 
with each processing unit (i,e, layer) employing output from other processing units (i,e, 
layer) and provides output for use by other processing units (i,e. layer) in their 
respective processing function Jfig, 6-1], 
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Regarding claim 11, Chu meets the claim limitations, as foUows: 

A data structure stored on a computer-readable medium (Le. metadata) for describing 
perceptual data of a digital image 6-1] comprising: numeric data that describe the 
digital image [fig, 6-1; page 149, para. 4; RL layer, image pixel data]\ linguistic data that 
describe the digital image, the linguistic data including segmentation (i,e, section 6 J.I) 
[fig, 6-1; page 149, para, 4; KL layer, TAH]; indices (i.e, layer) that identify the numeric data 
. and the linguistic data with each level of processing, the indices including ordinate 
level within schema structure, perceptual schema, and human categorization [fig. 6-1; 
page 149, para, 4]; and labels (i,e, SR- spatial relationship) that associate the numeric data 
(ie, pixel data) and the linguistic data (i.e. TAH) with perceptual concepts (i.e. shape and 
spatial relationship) [fig, 6-1; page 150, para, 3], 

Chu does not expUcidy disclose the following claim limitations (emphasis added): 
Color segmentation. 

However, in the same field of endeavor Gonzalez discloses the deficient claim limitations, as 
foUows: 

Color segmentation [page 331 , para, 2], 
It would have been obvious to one with ordinary skill in the art at the time of invention to 
modify the teachings of Chu with Gonzalez to implement color segmentation, the reasoning 
being to apply Chu's invention to color images. 



Regarding claim 12, Chu meets the claim limitations, as follows: 



1 

r 
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A method of query processing in an electronic image retrieval system [fig. 6-11], 
comprising: receiving one or more query (i.e, KEQL.) input describing the image in 
linguistic terms [page 172, para. 1J; translating (Le. query planner) the linguistic query 
input (Le. KE^L) into a query image descriptor (i.e. query execution graph), the query 
image descriptor including segmentation (ue. feature extraction) [fig. 6-11; page 172, para. 
1]; comparing the query image descriptor to the image descriptor of images stored in 
a database [/)age 176, para, 4]; and retrieving the image with image descriptor that 
most closely matches the query image descriptor /page 176, paras. 4 and 5]. 
Chu does not explicidy disclose the following claim limitations (emphasis added): 
Color segmentation. 

However, in the same field of endeavor Gonzalez discloses the deficient claim limitations, as 
follows: 

Color segmentation [page 3 51, para. 2]. 
It would have been obvious to one with ordinary skill in the art at the time of invention to 
modify the teachings of Chu with Gonzalez to implement color segmentation, the reasoning 
being to apply Chu*s invention to color images. 

Conclusion 

[6] Applicant's amendment necessitated the new ground(s) of rejection presented in this Office 
action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). AppUcant is 
reminded of the extension of time policy as set forth in 37 CFR 1.136(a). 
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A shortened statutory period for reply to this final action is set to expire THREE MONTHS 
from the mailing date of this action. In the event a first reply is filed within TWO MONTHS of the 
mailing date of this final action and the advisory action is not mailed until after the end of the 
THREE-MONTH shortened statutory period, then the shortened statutory period will expire on 
the date the advisory action is mailed, and any extension fee pursuant to 37 CFR 1.136(a) will be 
calculated from the mailing date of the advisory action. In no event, however, will the statutory 
period for reply expire later than SIX MONTHS from the date of this final action. 

Contact Information 

[7] Any inquiry concerning this communication or earlier communications from the examiner 
should be directed to Mr. Sath V. Perungavoor whose telephone number is (571) 272-7455. The 
examiner can normally be reached on Monday to Friday from 8:30am to 5:00pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's supervisor, 
Mr. Matthew C. Bella whose telephone number is (571) 272-7778, can be reached on Monday to 
Friday from 9:00am to 5:00pm. The fax phone number for the organization where this application 
or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 

r 

may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR system, 
see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR system, 
contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
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Sath V. Perungavoor 
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